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Abstract 

It has been shown that max-plus linear systems are well suited for applications in synchronization and 
scheduling, such as the generation of train timetables, manufacturing, or traffic. In this paper we show that 
the same is true for multi-legged locomotion. In this framework, the max-plus eigenvalue of the system matrix 
represents the total cycle time, whereas the max-plus eigenvector dictates the steady-state behavior. Uniqueness of 
the eigenstructure also indicates uniqueness of the resulting behavior. For the particular case of legged locomotion, 
the movement of each leg is abstracted to two-state circuits: swing and stance (leg in flight and on the ground, 
respectively). The generation of a gait (a manner of walking) for a multiple legged robot is then achieved by 
synchronizing the multiple discrete-event cycles via the max-plus framework. By construction, different gaits and 
gait parameters can be safely interleaved by using different system matrices. In this paper we address both the 
transient and steady-state behavior for a class of gaits by presenting closed-form expressions for the max-plus 
eigenvalue and max-plus eigenvector of the system matrix and the coupling time. The significance of this result 
is in showing guaranteed robustness to perturbations and gait switching, and also a systematic methodology for 
synthesizing controllers that allow for legged robots to change rhythms fast. 

Index Terms 

Discrete-event systems, max-plus algebra, coupling time, legged locomotion, gait generation, robotics 

I. Introduction 

Synchronization of cyclic processes is important in many fields, including manufacturing I15TL trans- 
portation 113111 . genomics [48], and neuroscience ll34l l50l . etc (see references within lfl"3l0 . In this paper 
we focus on a class of multiple concurrent two-state cyclic systems with a direct application to legged 
locomotion. Our motivation is the requirement of legged mobile robots to cope with unstructured terrains 
in a flexible way by smoothly and effectively switching between different gaits. 
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Legged systems are traditionally modeled using cross-products of circles in the phase space of the set 
of continuous time gaits. Holmes et al. |[34ll give an extensive review of dynamic legged locomotion. 
The central pattern generator ll35ll approach to design motion controllers lies in assembling sets of 
error functions to be minimized that cross-relate the phases of multiple legs, resulting in attractive limit 
cycles for the desired gait. Switching gaits online is typically not addressed since in the central pattern 
generator framework switching must be modeled as a hybrid system. Additionally, implementing "hard 
constraints" on the configuration space ll29ll can be quite complex mainly due to the combinatorial nature 
of the gait space, and often it comes at the cost of dramatically increasing the complexity of the controller. 

As an alternative to the common continuous time modeling approach, we introduce an abstraction to 
represent the combinatorial nature of the gait space for multi-legged robots into ordered sets of leg index 
numbers. This abstraction combined with max-plus linear equations allows for systematic synthesis and 
implementation of motion controllers for multi-legged robots where gait switching is natural and the 
translation to continuous-time motion controllers is straightforward [|38l . The methodology presented is 
particularly relevant for robots with four, six, or higher numbers of legs where the combinatorial nature of 
the gait space starts to play an important role. For a large number of legs it is not obvious in which order 
each leg should be in swing or in stance. Most legged animals, in particular large mammals, are known 
to walk and run with various gaits on a daily basis, depending on the terrain or how fast they need to 
move. The discrete-event framework presented in this paper enables the same behavior for multi-legged 
robots. Mathematical properties are derived for this framework, giving extra insight into the resulting 
robot motion. 

The main mathematical representation employed in this paper are switching max-plus linear equations. 
By defining the state variables to represent the time at which events occur, systems of linear equations in 
the max-plus algebra 01CLT1I321 can model a class of timed discrete-event systems. Specifically, max-plus 
liner systems are equivalent to (timed) Petri nets P4l where all places have a single incoming and a 
single outgoing arc. Max-plus linear systems inherit a large set of analysis and control synthesis tools 
thanks to many parallels between the max-plus -linear systems theory and the traditional linear systems 
theory. Discrete-event systems that enforce synchronization can be modeled in this framework. Max-plus 
algebra has been successfully applied to railroads 01 [32, queuing systems [f30]|. resource allocation |[T9l , 
and recently to image processing [2] and legged locomotion ll38l l39l . 

The contributions of this paper are the following: we present a class of max-plus linear systems that 
realize the synchronization of the legs of a robot. Next, we derive closed-form expressions for the max- 
plus eigenvalue and eigenvector of the system matrix, and show that the max-plus eigen-parameters are 
max-plus unique, implying a unique steady-state behavior. This result is then used to compute the coupling 
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Lemma 14) 
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(Theorem 15) 



Transient 



Coupling time 
(algebraic computation, Lemma 16) 



Fig. 1. Structure of the contributions of this paper. We analyze both the steady-state and the transient behavior of a class of cyclic 
discrete-event systems that are well suited to model legged locomotion. 



time, which characterizes the transient behavior. The importance of having closed-form expressions and 
uniqueness of the max-plus eigen- structure is that, not only can one compute these parameters very fast 
without recurring to simulations or numerical algorithms (e.g. Karp's algorithm [0Q), but one has also 
guarantees of uniqueness: the motion of the robot will always converge in a finite number of steps to 
the same prescribed behavior, regardless of gait changes or disturbances. This reassurance is fundamental 
when designing gait controllers for robotics. Additionally we present a low least number of steps needed 
to reach steady-state motion after changing gaits. This paper is focused on the general mathematical 
properties of a class of discrete-event systems that describe legged locomotion, and not on the actual 
implementation of gait controllers for robots, as presented previously in ll38l . 

In Section [XT] we revisit the fundamentals of legged locomotion with special emphasis on gait generation 
and show that max-plus algebra can be used in the modeling of the synchronization of multiple legs. In 
Section [In] we briefly review relevant concepts from the theory of max-plus algebra and in Section |IV] we 



present a class of parameterizations for the gait space. Given such class, we derive a number of properties, 



such as the max-plus eigen- structure of the system matrices (Section IV-C), their graph representation 



(Section IV-D), and the coupling time (Section IV-E). Figure [T] illustrates the structure of the contributions 
presented in this paper. 



Fig. 2. Modeling of legged locomotion, a) The configuration space of two oscillators is a torus. Synchronization is achieved by constructing 
attractive limit cycles, represented by the curve on the torus, b) Discrete-event representations of multiple circuits can be modeled as 
concurrent cyclic Petri nets. Synchronization is achieved by adding extra places, represented by S2 and S2. 



II. Modeling legged locomotion 



In literature [|T4ll28l[34ll45ll46l . the study of legged locomotion is approached from two main directions: 
the signal generation side, where emphasis is placed on the classes of signals that result in periodic 
locomotion behavior independent of the physical platform; and the mechanics side, where the (hybrid) 
Newtonian mechanics models are analyzed independently of the driving control signal. We focus on the 
first approach, by restating the traditional view of periodic gaits for legged systems being defined in the 
n-torus: Cartesian products of circles each representing an abstract phase that parameterizes the position 
of each leg in the Euclidean space. Such an abstraction serves as a platform for the models of "networks 
of phase oscillators" and central pattern generators, introduced in the earlier works of Grillner Il27l and 
Cohen et al. 0. These are now accepted by both biology and robotics communities as standard modeling 
tools Il34l. 



In this paper we abstract beyond the notion of a continuous phase to consider concurrent circuits of 
discrete events. Taking a Petri net modeling approach, during ground locomotion the places represent leg 
stance (when the foot is touching the ground and supporting the body) and leg swing (when the foot and 
all parts of the leg are in the air). The transitions represent leg touchdown and lift off. This labeling is most 
convenient for ground locomotion, but one should be aware that the framework presented in this paper 
is valid for other types of locomotion where the phases of the various limbs need to be synchronized, 
such as swimming or flight. Figure [2] illustrates the conceptual difference between our approach (Figure 
|2jb) where each phase is represented by a circuit in the discrete-event systems domain and the traditional 
continuous phase central pattern generator (Figure |2]a). Here, phase synchronization is enforced on the 
torus by implementing controllers that achieve stable limit cycles 11371 . In this paper we translate timed 
event graphs^ into the equivalent representation as max-plus linear systems, and achieve synchronization 

'We restrict ourselves to a class of timed Petri nets called timed event graphs such that a one-to-one translation to max-plus linear systems 
is possible (see 1321 . chapter 7). In timed event graphs each place can have one single incoming arc and one single outgoing arc. 
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Fig. 3. Illustration of a walking pattern, photos by Muybridge 1 4-0 1 . The solid bars, following Hildebrand's diagram notation [ 33], indicate 
that the leg is in stance (foot touching the ground) for r g time units, and white space that the leg is in swing (foot in flight) for Tf time units. 
The time length when both feet are touching the ground is called the double-stance time ta. We use the notation ti(k — 1) to represent the 
time instant when leg 1 (left leg) touches the ground, and h (k) when it initiates a swing. The parameter k is the "step counter". 



by designing the system matrices appropriately. Consider the leg synchronization of a biped robot. In this 
case, only two legs need to be synchronized during locomotion. For a typical walking motion (no aerial 
phase) the left leg should only lift off the ground after the right leg has touched down, to make sure the 
robot does not fall due to lack of support. This simple synchronization requirement can be captured by 
introducing state variables for the transition events defined as follows: let li(k) be the time instant leg i 
lifts off the ground and U(k) be the time instant it touches the ground, both for £>th iteration, where k is 
considered to be a global event or "step" counter. Enforcing that the time instant when the leg touches 
the ground must equal the time instant it lifted off the ground for the last time plus the time it is in swing 
(denoted r f ) is realized by: 

t i (k) = U(k)+T i . (1) 

A similar relation can be derived for the lift off time: 

h(k) = U{k - 1) + r gJ (2) 

where r g is the stance time and ti(k — 1) refers to the previous iteration such that equations ([T|) and (|2j) 
can be used iteratively. For this system we have that Tf > and also r g > 0. Synchronization of the cycles 
of two legs can be achieved by introducing a double stance time parameter, denoted ta, representing that 
after each leg touchdown both legs must stay in stance for at least ta time units (see Figure [3]). This is 
captured by the following equations: 

h{k) = max(ii(fc- 1) + r g ,t 2 (k- 1) + t a ) (3) 
l 2 (k) = max{t 2 {k- 1) +r g ,t 1 (k) + t a ) (4) 

Equation ([3]) enforces simultaneously that leg 1 stays at least T g time units in stance and will only lift off 
at least ta time units after leg 2 has touched down. When both conditions are satisfied, lift off takes place. 
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Equation ([4]) is analogous for leg 2. Note that the parameters T{ , r g , and ta are in fact the minimal swing, 
stance, and double stance times, respectively, as opposed to the exact times. Note additionally that these 
equations are non-linear but they rely only on the "max" and "plus" operations. This motivates the use 
of the theory of the max-plus algebra to find parsimonious discrete-event models for legged locomotion. 
Although the previous set of equations were designed for a walking behavior with no aerial phases, in 
practice they can also be used for running by choosing the double stance time to be negative, i.e. by 
enforcing that one leg lifts off ta time units before the other leg touches the ground. However, the results 
presented in this paper focus on the case when ta ^ such that stability (in the sense of ensuring a 
desired minimum number of legs on the ground simultaneously) is guaranteed. 

III. Max-plus algebra 

In the early sixties the fact that certain classes of discrete-event systems can be described by models 
using the operations max and + has been discovered independently by a number of researchers, among 
whom Cuninghame-Green BH [TOj and Giffier ll2"Tl - l23l . These discrete-event systems are called max- 
plus-linear systems since the model that describes their behavior becomes "linear" when formulated it 
in the max-plus algebra Q3 [UJ [321, which has maximization and addition as its basic operations. More 
specifically, discrete-event systems in which only synchronization and no concurrency or choice occur can 
be modeled using the operations maximization (corresponding to synchronization: a new operation starts 
as soon as all preceding operations have been finished) and addition (corresponding to the duration of 
activities: the finishing time of an operation equals the starting time plus the duration). Some examples of 
max-plus linear discrete-event systems are production systems, railroad networks, urban traffic networks, 
queuing systems, and array processors flU [UJ [32). 

An account of the pioneering work of Cuninghame-Green on max-plus system theory has been given in 
IfTTll . Related work has been done by Gondran and Minoux 11241 - 1261 . In the eighties the topic attracted new 
interest due to the research of Cohen, Dubois, Moller, Quadrat, Viot j6l-[8l, Olsder PTT - 1431 . and Gaubert 
lfl5l4T71l . which resulted in the publication of 0]|. Since then, several other researchers have entered the 
field. For an historical overview we refer the interested reader to lfT2l |20l [321 . In this section we give 
an introduction to the max-plus algebra. This section is based on [CD (EEL where a complete overview of 
the max-plus algebra can be found. The basic operations of the max-plus algebra are maximization and 
addition, which will be represented by © and <g> respectively x®y = max(x, y) and x © y = x + y, 
for x,y G M m ax : = l&U { — °°}- The zero element for © in K max is e := — oo and the unit element for 
© is e := 0. The structure (K m ax, ©, ©) is called the max-plus algebra 03 [TTJ. The operations © and © 
are called the max-plus-algebraic addition and max-plus-algebraic multiplication respectively since many 
properties and concepts from linear algebra can be translated to the max-plus algebra by replacing + 
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by © and x by ©.The max-plus algebra is a typical example of a class of algebraic structures called 
commutative dioids. In a dioid the additive operation © is associative, commutative, and idempotent, and 
it has a zero element; the multiplicative operation © is commutative and associative and it has an identity 
element; the additive zero element is absorbing for ©; and © is left and right distributive w.r.t. ©. Let 
r G R. The rth max-plus power of x G R is denoted by x® r and corresponds to rx in conventional 
algebra. If x G R then x®° = and the inverse element of x w.r.t. © is x® -1 = —x. There is no inverse 
element for e since e is absorbing for ©. If r > then e® r = e. If r < then e 07, is not defined. In 
this paper we have e®° = by definition. The rules for the order of evaluation of the max-plus operators 
are similar to those of conventional algebra. So max-plus power has the highest priority, and max-plus 
multiplication © has a higher priority than max-plus addition ©. Throughout this paper the i,j element 
of a matrix A is denoted by [A]^. The matrix £ mxn is the m by n max-plus zero matrix: [£ m xn\ij = £ 
for all The matrix E n is the n by n max-plus identity matrix: [E^\u = e for all i and [E n ]ij = e for 
all i,j with i ^ j. We also define the m by n max-plus "one" matrix t mxn such that [l]y = e = for 
all If the dimensions of S, E, 1 are omitted in this paper, they should be clear from the context. The 
basic max-plus-algebraic operations are extended to matrices as follows. If A, B 6 1™^", C G R™ax tnen 

[A © B] y = © [B]ij = max([A] tj , [B]^) (5) 

n 

[A © CJy = (£)[A] ip © [C] pi = max {[A] ip + [C] pj ) (6) 

^-J — p=l,...,n 
p=l 

for all Note the analogy with the definitions of matrix sum and product in conventional linear algebra. 
The max-plus product of the scalar a G M max an d the matrix A G R^al™ ls defined by [a® A]y = a© [A]^ 
for all i, j. The max-plus matrix power of A G is defined as follows: A® = E n and A® p = A&A®?' 1 
for p ^ 1. 

Theorem 1 (see LI], Th 3.17). Consider the following system of linear equations in the max-plus algebra: 

x = A © x © b (7) 

wi/fc A G M™*™ and 6, x G R"^. Now let 

OO 

A* := 0A 0P . (8) 

If A* exists then 

x = A* © 6 (9) 
solves the system of max-plus linear equations f7]) 
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Definition 2. The matrix A E M™*™ is called nilpotent if there exists a finite positive integer p such that 
for all integers p ^ p we have A® p = S. 

It is easy to verify that if A E is nilpotent then p ^ n. For A, B E M™*™ we say that A 

overcomes B, written as A ^ B if A © B = A (i.e., [A]ij ^ [B]ij for all A directed graph Q is 
defined as an ordered pair (V,A), where V is a set of vertices and A is a set of ordered pairs of vertices. 
The elements of A are called arcs. A loop is an arc of the form (v,v). Let Q = (V, A) be a directed 
graph with V = {v i, v%, . . . , v n }. A path p of length / is a sequence of vertices v^, v i2 , . . . , t> i;+1 such that 
(v ik , v ik ) G *4 for k — 1,2, ... ,1. We represent this path by v ix —>■ v i2 —>•... —>■ f j and we denote the 
length of the path by |p|i = /. Vertex u ia is the initial vertex of the path and is the final vertex of the 
path. The set of all paths of length I from vertex to is denoted by P(t> il , t> i; ; /). When the initial 
and the final vertex of a path coincide, we have a circuit. An elementary circuit is a circuit in which 
no vertex appears more than once, except for the initial vertex, which appears exactly twice. A directed 
graph Q = (V, A) is called strongly connected if for any two different vertices Vi, Vj E V there exists a 
path from vi to Vj. If we have a directed graph Q = (V, A) with V = {1, 2, . . . , n} and if we associate 
a real number [A]^ with each arc E A, then we say that Q is a weighted directed graph. We call 
[A]ij the weight of the arc (j, i). Note that the first subscript of [A]ij corresponds to the final (and not the 
initial) vertex of the arc 

Definition 3 (Precedence graph). Consider A E IR™*"- The precedence graph of A, denoted by Q{A), is a 
weighted directed graph with vertices 1, 2, . . . , n and an arc (j, i) with weight [A]ij for each [A].^ ^ e. 

Let A E and consider Q(A). The weight \p\ w of a path p : i\ — y i 2 — >■ . . . — > ii+i is defined 

as the sum of the weights of the arcs that compose the path: \p\ w = [A] i2il + [A] iai2 + . . . + = 
®fc=i[-^-]ifc+i*fc" The average weight of a circuit is defined as the weight of the circuit divided by the length 
of the circuit: |p| w /b|i- 

Definition 4 (Irreducibility). A matrix A E I^max ^ called irreducible if its precedence graph is strongly 
connected. 

Definition 5 (Max-plus eigenvalue and eigenvector). Let A E M™*™. If there exist a number A G M ma x and 
a vector v E l" ax with v ^ £ n xi such that A <g> v = X <S> v , then we say that A is a max-plus eigenvalue 
of A and that v is a corresponding max-plus eigenvector of A. 

It can be shown that every square matrix with entries in M max has at least one max-plus eigenvalue (see 
e-g- Hll). However, in contrast to linear algebra, the number of max-plus eigenvalues of an n by n matrix 
is in general less than n. If a matrix is irreducible, it has only one max-plus eigenvalue (see e.g. fl6)). 
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Moreover, if v is a max-plus eigenvector of A, then a®v with a e E is also a max-plus eigenvector of A. 
The max-plus eigenvalue has the following graph-theoretic interpretation. Consider A G i™^. If A max is 
the maximal average weight over all elementary circuits of Q(A), then A max is a max-plus eigenvalue of 
A. For formulas and algorithms to determine max-plus eigenvalues and eigenvectors the interested reader 
is referred to Q3 HI [61 [36] and the references cited therein. Every circuit of Q (A) with an average weight 
that is equal to A max is called a critical circuit. The critical graph Q C (A) of the matrix A is the set of all 
critical circuits. Let N be the set of positive, non-zero integers. 

Theorem 6. Let A be an irreducible matrix. Then there exists c G N ( the cyclicity of A), A G M. ( the 
unique max-plus eigenvalue of A ), and k G N ( the coupling time of A) such that 

Vp^k : A m+C = \ m ®A® p (10) 

Proof See e.g. 0] E ED • □ 

IV. Legged locomotion via max-plus modeling 

In Section |Il] equations ([T]), ([3]), and ([4]) describe the synchronization constraints between two legs. We 
can generalize these equations by defining the following vectors for an n-legged robot: 

t(k) = [hik) ■■■ t n (k)f (11) 

l(k) = {h(k) •■■ l n (k)f (12) 

Equation ([T]) is then written as: 

t(k) = r { ®l{k) (13) 

If one assumes that the synchronization is always enforced on the lift off time of a leg, equations Q and 
([4]) are written jointly as: 

l{k) = T g ®t(k-l)@P®t(k)@Q®t(k-l), (14) 

where the matrices P and Q encode the synchronization between lift off of a leg related to a touchdown 
of the current event (as in equation Q) and a touchdown of the previous event (as in equation ([3])), 
respectively. The rationale behind this particular model is to prevent that a legged platform has too many 
legs in swing while walking^] risking falling down. Synchronization constraints are always imposed on 
legs that are in stance and are about to enter swing: some legs should only swing if others are in stance 



(equation (14)). Once in swing, legs are never constrained to go into stance (equation (13)). 
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As mentioned previously in this paper we don't consider running, although it can still be achieved using the same class of models. 
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Equations (fl~3]) and ([14]) are written in state-space form as: 



t(k) 




£ 


Tt®E 




t(k) 


l(k) 




P 


£ 




l(k) 



Define the matrices 
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(15) 



(16) 



Consider the full state x defined as x(k) = \t T (k) l T {k)] T . Equation (15) can then be written in simplified 
notation: 



x(k) = A ® x(k) © Ai <g> x(k - 1). 



(17) 



Note that additional max-plus identity matrices E are introduced in the diagonal of matrix A\. This results 
in the extra trivial constraints U(k + 1) ^ U(k) and k(k + 1) ^ h(k), also resulting in the final system 
matrix (defined in page 13 equation p5j)) being irreducible. This is observed later on in Lemma 12 



A. A gait parameterization 

Consider a general legged robot where a two-event circuit is associated to each leg. We present a 
parsimonious representation of a walking gait of a robot by grouping sets of legs and specifying in what 
order they are allowed to cycle. 

Definition 7. Let n be the number of legs in the robot and define m as a number of leg groups. Let 
£i, . . . , £ m be ordered sets of integers such that 

m 

\j£ p = {l,..., n}, Vi ^ j, £i n £j = 0, and Vi, U ^ (18) 
P =i 

i.e., the sets £ p form a partition of {1, ... ,n}. A gait G is defined as an ordering relation of groups of 
legs: 



G = £ 1 -< £ 2 -<■■■-< £ m 
The gait space is the set of all gaits that satisfy the previous definitions. 



(19) 



By considering that each £ p contains the indices of a set of legs that are synchronized in phase, the 
previous ordering relation is interpreted in the following manner: the set of legs indexed by l{ swings 
synchronously. As soon as all legs in £j touchdown then all legs in £ i+ i initiate their swing motion. The 
same is true for £ m and l\, closing the cycle. For example, a trotting gait, where diagonal pairs of legs 
move synchronously, for a quadruped robot as illustrated in Figure |4} is represented by: 

G trot = {l,4}^{2,3} (20) 
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Fig. 4. Walking robots with recirculating legs inspired by RHex [47|. Zebro robot on the left and RQuad on the right both developed at 
DCSC, Delft University of Technology. The numbers represent the leg index numbering assumed in this paper. 



The gait space defined above can represent gaits for which all legs have the same cycle time. As such, 
gaits where one leg cycles twice while another cycles only once are not captured by this model. Examples 
of such gaits are not common, but have been used on hexapod robots to transverse very inclined slopes 



sideways [14911 . With the previous notation we can now derive the matrices P and Q in equation (15): 

Ta Vj G {1, . . . , m- 1}; Wp G e j+ r,Vq G £j 
e otherwise 



[P] 



pq 



[Q]pq = 

For the trotting gait G tro t we obtain 



r A VpG4;VgG 
e otherwise 



(21) 
(22) 
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(23) 



Define the function b that transforms a gait into a vector of integers: 

b : {[£ 1 ] 1 ,...,[£ 1 ] n }^...^{[C] 1 ,...,[Ck}^ 



(24) 



Using again the previous trotting example we get that b (G tro t) = [1 4 2 3] T (the symbol flat "b" is 
chosen since it "flattens" the ordered collection of ordered sets of a gait into a vector). Note that the 
gaits {1,4} -< {2,3} and {4, 1} -< {2,3} although resulting in indistinguishable motion in practice, have 
different mathematical representations since b ({1,4} -< {2,3}) ^ b ({4, 1} -< {2,3}). 



Definition 8. A gait G is called a normal gait if the elements of the vector b (G) are sorted increasingly. 
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For a gait G, define the similarity matrix C G M™*™ as 

e if [KG)]* = j 



,Vi,j e {!,..., n} 



(25) 



trot 



(26) 



£ otherwise 

The similarity matrix C is such that C <g> C T = C T ®C = E. The similarity matrix associated with the 
trotting gait G trot is: 

— oo — oo — oo 
— oo — oo — oo 
— oo — oo — oo 
— oo — oo — oo 

here written in both max-plus and traditional algebra notation for legibility purposes. The similarity matrix 
C has the property of "normalizing" the P and Q matrices to a max-plus algebraic lower triangular form 
P and a max-plus algebraic upper triangular form Q respectively: 

P = C®P®C T 



e e e e 
esse 
sees 
sees 



Q = C®Q®C 1 

Taking the previous example of the trotting gait, the normalized matrices take the form 



(27) 
(28) 



trot 



e see 

e see 

t a t a e e 

t a t a e e 



and Q 



trot 



e e r A t a 

e e t a t a 

see e 

see e 



(29) 



which are generated by the normal gait {1,2} -< {3,4}. Let represent the number of elements of the 
set li. For a general normal gait 



g = t x < £ 2 -< — < e„ 

with lj j = t #£ . x # e . the structure of the matrices P and Q is 

8 ■■■8 

ta <8> l2,i 8 : 

8 T A ® I 3)2 8 

8 ■■■ TA®l m ,m-l £ 



(30) 



Q = 



8 t a ® l hm 
8 8 



(3D 
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From equation (31 ) it is clear that the matrix P is always max-plus nilpotent, since the upper triangle is 
max-plus zero. For max-plus powers of P we obtain: 



£ 
£ 

r A ® l 3jl 
£ 



£ 



£ 
£ 



7~a © l m m _ 2 £ £ 



m— 1) 



T"A © l m ,l £ " " " £ 



£ 



Lemma 9. Max-plus nilpotency is invariant to max-plus similarity transformations (e.g. as defined in 



equations ( |z7j ), (|28])J. 

Proof: Let P be nilpotent and C be a similarity matrix. Let P = C T © P © C. As such 

P®p = (C T ®F® C)® P = C T ©P^C©C T ©P©C©---©C T ©P^C = C T ©P 0p ©C (32) 
and, 3p > 0, Vp ^ p : P 0p = C T © P m © C = 5. □ 



Given an arbitrary gait G with associated matrices P, Q, A , and Ai one can find the normal matrix 
P which is max-plus nilpotent. From Lemma w\ then P is also max-plus nilpotent. In the beginning of 



Section IV we have presented the synchronization equations (17) implicitly. However, if Aq exists then 
using equations and ([9]), system (17) can be transformed into an explicit set of equations. 

Lemma 10. A sufficient condition for Aq to exist is that the matrix P is nilpotent in the max-plus sense. 

Proof: By direct computation, the repetitive products of A can be found to be 



An 





£ 


r f 2 © P 65 2 




© P^ 






< 


rf § © P®z 




£ 






£ 


® 


2 <g> P®i 





if p is odd 



if p is even 



(33) 



If P is max-plus nilpotent, then there exists a finite positive integer p such that Vp ^ po : P® p = £ 



^( 2p +i) = 5, and therefore the max-plus sum for the computation of Aq is finite: 

oo 2p 
A* — £D A® q — CJ^ A® q 

g=0 q=0 



(34) 



□ 



Since P is always max-plus nilpotent for gaits generated by expressions (21) and (22), we conclude 
that A* G is well defined. Let A, that we call system matrix, be defined by: 



A = A* © A l 



(35) 
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Equation (17) can be rewritten as: 

x(k) = A ® x(k) © A\ <g> x(k 



1) = A* ® Ai ® - 1) = A ® z(jfe - 1). 



(36) 



C 



(37) 



For an arbitrary gait the internal structure of A can be quite complex. However, the gait G associated to 
A can be transformed into a normal gait via a similarity transformation. Let 

C 8 
8 C 

The similarity matrix C transforms the system matrix A of an arbitrary gait G into the system matrix 
A of a normal gait G via the similarity transformation A = C ® A ® C T . This can be shown by direct 
computation: 



C(i 


3 At 


3C T 




c® 


Al®C T 


®C g> 


A 1 <g 


)C T 








C 


8 


® 


8 


n®E 


* 

® 


c 




T 

® 


c 


8 




8 


C 


P 


8 




8 






8 


C 




C 


8 






r f ®E 


® 


C 


8 


8 


C 




P 


8 




8 


C 



® 



E 


8 


T g ® E 




E 




E 





® 



C 8 
8 C 

8 



C 



E®Q)®C 7 



E 



( 



2 in 

© 

9=0 



V 



8 


Tf ® E 


P 


8 


Ao 



E 


8 


T g ®Ei 




E 



A* 



A X =A 



(38) 



/ 



Transforming an arbitrary gait into a normal gait is very useful since, by effectively switching rows and 
columns in A, one obtains a very structured matrix A where analysis is simple. The interpretation of the 
similarity matrix C is that legs can be renumbered, simplifying algebraic manipulation. Besides max-plus 
nilpotency, other properties are invariant to similarity transformations: irreducibility is preserved since the 
graphs of A and A are equivalent up to a label renaming. Max-plus eigenvalues and eigenvectors are 
related by: 



A®v = \®v<^C®A®C T ®C®v = \®C®v^A®v = \®v, with v = C ® v 



(39) 



B. Structure of the system matrix A 
Let: 



Tg = Tf <g> r A and r 7 = r f <g> t„ 



(40) 
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The structure of A can be obtained via a laborious but straightforward set of algebraic manipulations. For 
an arbitrary gait G we compute the normal gait G via the similarity transformation with the matrix C. By 
observing the structures of A and A x (derived from P and Q) a closed-form solution can be obtained 



for A*: 



A* 



W 
W 



w 



(41) 



where W = (r f © P)*, illustrated in equation (48) on page 16 The matrix W is defined in equation (47) 



again on page 16 Note that Tf <g> W © E = W and W ^ W. An expression for A is then obtained: 



.4 



A* ® Ai 



W © T{ © T„ 



W 



To- 



W T f ®W 

w w 

W © r f © W © Q 
W@W®Q 



E 

r g ®E®Q 

r f © W 
W 



Let V = W © Q, as illustrated by equation (49). One can show that: 



W® W = W 
W ®V = V 

V®V = r? (m - 1} © r A © V 



Since /i © ^ W for any // > 0, and W ^ W, expression (|42j) simplifies to: 

r f © (r g © © V) T f ®W 
T g ®W@V w 



A 



£ 
E 



(42) 



(43) 
(44) 
(45) 



(46) 



Let t [<(]l (A;) t [kh {k) 



i T 



hid** ( k ) 



(k) \~ and l £i (k) = 

Equations (50)-(53) illustrate the resulting structure of A written in the system form x(k) = A®x(k — 1), 
with x(k) = C © x(k), and Ei = E^. In equation (53), the © operator is omitted in unambiguous 
locations due to space limitations. 



C. Max-plus eigenstructure of the system matrix 

Given a parameterization of a gait, it is fundamental to understand whether the system a; (A;) = A © 
x(k — 1) reaches a unique steady state behavior. In robotics this is the equivalent of asking "does the 
robot walk/run as specified? Is it robust to disturbances?". These questions are answered by analyzing 
the max-plus eigenstructure of the system matrix: a unique eigenvalue means that the legs have a unique 
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W = T A 



1 2 ,1 

® 13,1 



13,2 



Tg ® 12,1 -E2 

rf 2 <g> l 3 ,i ® 1 3 ,2 



rf ^ ® l m ,i 



V = 



x{k) = A® x(k - 1) 



- , n,(n— m) 



T<5 1L m,m— 1 ,m — 2 



£ 3 

rf 2 (g) l m , m _2 r«s®l m , m _i 

TA ® ll,m 
T A ® Tf ® l 2 , m 



r A ® rf (m " 1} ® l m , ra 



z(fc)= 


T t ® (r g ® W 7 


e v) 


1 Tf ® W 


r g ® vk e 


V 


w 






An 




An 








a 22 


A 23 


h t {k) 




A31 


a 32 


A33 


h m {k) _ 






a 42 


A43 



x(k - 1) 
t £l (fc - 1) " 



Mfc-i) 



(47) 



(48) 



(49) 

(50) 
(51) 



(52) 







Ty E± • • • & 


Tsll im 


T [El ■■■ £ 




^(fc-1) 






TyT$t2,l TyE'2 : 


rf 2 l 2 , m 


T"fT^l2,l Tf£?2 i 




te 2 (k-l) 


te m (k) 




<g)(m-l)| -T-T-.il 


T*yE m lm,ra 


TfTf^-^W ••• TfEm 




te m (k-l) 


l tl {k) 




T g i5l • • • £ 




E-y ■■■ £ 




hAk-l) 


h 2 (k) 




T g Tst2,l T g E 2 : 


TAT,sl 2 ,m 


T 6 t 2 ,i E 2 : 




le 2 (k-l) 


h m {k)_ 




®(m-l)| = 


T F ffi -TA-r (g,(m ~ 1) il 


_®("»-i)f s 


✓ 


h m (k-l) 



(53) 



x(k) 



x(fc-l) 
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cycle time, and a unique (up to scaling) eigenvector means that the legs always reach the same motion 
pattern, independently of the initial condition or disturbances. The results obtained below use various 
analysis techniques available for max-plus linear systems. This is necessary due to the intrinsic time 
structure associated with the problem. Petri net tools (e.g. incidence matrices) can be used to understand 
structural properties of the system, such as irreducibility, but temporal properties are better analyzed using 



max-plus linear tools. In Section IV-D we show that for a fixed structure (i.e. a single Petri net) unique 
or non-unique eigenvectors are found by changing the holding time parameters. This result could not be 
captured by the Petri net structure alone. The analysis steps presented from here on are summarized in 
Figure [T] 

Consider the following assumption (which is always satisfied in practice since the leg swing and stance 
times are always positive numbers): 

Assumption (Al). r g , r f > 

Lemma 11. If assumption Al is satisfied then 

\ : = T f m © r 7 (54) 



is a max-plus eigenvalue of the system matrix A (and A) defined by equations (|56J) (and (p0[)-(|53[) ), and 
v G M r 2 n n ax defined by 



Vj G {1, . . . ,m}, Vg G i 3 : [v] q := r f ® rf " x (55) 

[v]q+n ■= T~l 



(56) 



is a max-plus eigenvector of A. 



Proof: With v G M" ax , let [v] q = [v] q+n for all j and q G £j. Then v = [(r f ® v) T v T } T . Recall 
equations ([7]) and ([9]) with new variables z and B such that z = B ® z © b with solution z = B* © b. Now 
let z = A © v , B = A , and b = Ai © v. We obtain 

A©v = A <g) \®v ® A 1 ® vA* ®A 1 <g)v = A®v (57) 

Given the previous result, it is sufficient to show that if A and v are a max-plus eigenvalue and eigenvector 



of A respectively, then replacing the state variable x(k— 1) by v and x{k) by A ©t> in equation ( 15 ) holds 
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true: 



A ®v = A 



Tf © V 
V 



£ 




P 


£ 



E 


£ 




3Q 


E 



© f 



p 


A$ 


~§ Tf® E 


© 


Tf © f 


A®p©r g <g>p©Q 


E 







(58) 



The previous expression is equivalent to the following two equations: 

\®V = Tf®(\®P®T g ®E®Q)®V®V 



(59) 
(60) 



Since A > (by assumption Al), equation (59) is always verified. Thus we focus on equation (60), which 
can be simplified due to r f © r g > 0: 



A © v 



(r f © r g ) © v © r f © (A <8) P © Q) © v 



(61) 



Let ta <S> Po = P and ta © <5o = Q, i-e., all entries of matrices P and Qo are either e or e to obtain 
(recall that t s = r f <g> r A and r 7 = r f <8> r g ): 



A © U = r 7 © v © ra © (A ® P © Q ) ® v 



(62) 



We now consider two cases: 



i) First we analyze the row indices of equation (62) that are elements of the sets £ 2 ,...,£ m . For each 



j G {1, . . . , m — 1} and for each row p G £j+i we obtain (notice that according to (22) all the elements 
of [Qq] are e since p ^ £\, and that [u] = rf J for p G £j+x): 

[A © v] p = [r 7 © u] p © r 5 © [A © P © Q © v] p ^ 



A © \v] 



A © rf 3 



r 7 © © T S © [A © P ] Pi . © v © [Qo] P) . ®^ ^ 



r 7 ©r a 



A © r 



r 5 © A © [P ] m © 

-1 



r 7 © rf 3 © r 5 © A © r\ 



A©rf = r 7 ©rf © A © rf 



(63) 
(64) 

(65) 

(66) 
(67) 



The last term always holds true since A ^ r 7 . Thus for rows p E £2 



5 • • • > *-m 



equation (62) holds true 



ii) We now look at all the remaining rows p such that p G £\ (noticing now that according to (21 ) all the 
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elements of [PoL. are £ and that [u] = e since p G £1): 



v] © r,5 © [A © P © Qo\ Pi . 



A <g) H p = r 7 © r 5 (8) [A ® P ] pi . © t> © r 5 © [Q ] p> . ® w ^ 
A 



A 
A 



r 7 © 7* <8>0[Q o ] p , g ® 

e 

5m— 1 



r 7 © 75 © 77 



T 7 © Tj 



Combining i) and ii) we conclude that equation ([62]) holds true 



(68) 
(69) 

(70) 

(71) 
(72) 

□ 



Consider again the trotting gait for a quadruped G tro t defined in (20). For this gait m = 2, resulting 



in: 



^trot 



Tf (r A ©rf 2 ) (r A ©r® 2 ) r f (r A © r f ) (r A © r f ) 



Atrot = (r f © r A f 2 © r f © r g 



Lemma 12. Matrices A and A are irreducible. 



Proof: The sub-matrices A12, A22, A 32 , A42, A 2 i defined in expressions (52) and (53) have all their 
elements different from e. The sub-matrix A 2 3 has all diagonal elements different from e. As such, any 
node can be reached by any other node via the rows defined by A 12 , A 22 , A 32 , A A2 and the columns defined 
by A21, A 22 , A 23 . Therefore A is irreducible. Since A is a similarity transformation away from A then we 
conclude that A is also irreducible. □ 



Corollary 13. The max-plus eigenvalue X of A (and A) given by (54) is unique. 



The max-plus eigenvector v defined by (55)-(56) is not necessarily unique, given assumption Al alone. 
Since, to the authors' best knowledge, there exists no algebraic method to prove max-plus eigenvector 
uniqueness in general, we take advantage of the precedence graph of A to further investigate this property. 
If the critical graph of a irreducible max-plus system matrix has a single strongly connected subgraph, 
then its max-plus eigenvector is unique up to a max-plus scaling factor (see 0], Theorem 3.101). We 
proceed by computing the critical graph(s) of A. 



D. The precedence graph of A 



Given expression (53) it is possible to construct the precedence graph of A. Since this graph can be 
quite large for a general A, we find it more efficient to first group "similar" nodes into a single node, 
i.e. apply a procedure called node reduction (Figure [5]). Next, we show various subgraphs of the graph 
of A to better illustrate its structure (Figure [6]). The total precedence graph of A is thus the combination 
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of Figures [5] and |6j The process of constructing the graph of A starts by grouping all nodes of an event 
associated with a group of legs ^ into a single node. This can be accomplished since event nodes from 
the same group of legs ^ have "similar" incoming and outgoing arcs. As an example, consider the first 



set of #£1 rows of A as defined in expression (53): 



t tl {k) = T 1 ®E 1 ®tt 1 (k-l)@Ts®li, m ®tt m {k-l)@Tf®E 1 ®l il (k-l) (73) 



The precedence graph for equation (73) consists of 3 x nodes, since it involves the vectors t £l , t £m , 
and lg x . The relation between £^(fc) and ti x {h — 1) results in #£1 self connected arcs in the events 
with weights r 7 . Instead of expressing all elements of as individual nodes with self arcs, we reduce 
then to a single node with one self arc, as seen in Figure |5|-a2. The dashed attribute used on the self arc 
indicates that for each node in the group only self arcs exist, as expressed by the "connecting" matrix 
Ei. The relation between ti t (k) and U m (k — 1) is somewhat more involved, since it contains x j^l m 
arcs, as expressed by the connecting matrix li >m . The resulting node reduction is illustrated in Figure 
[5]-bl. The node reduction for the relation between tg 1 and is illustrated in Figure |5]-a4. Again we use 
dashed attributes on the arcs to represent the connecting matrix E±. For all other relations with connecting 
matrices 1 we use solid arcs. We make an exception in Figures [5]-cl to[5]-c4 where different line attributes 
are used to distinguish arcs from t ip — > t>, tg — » lg , etc. The same line attributes are used in Figures 
|6]-cl and[6]-c2. Note that multiple incoming arcs to a node are related via the © operation, e.g. as in the 
example ( [73] ) the node has 3 incoming arcs, illustrated in Figure [6} The following list summarizes the 
node reduction: 

• Figure [5j-al illustrates node reduction of the term rf m £g> l mjm of sub-matrix A 2 2 from expressions 



(J52J) and (j53J 

Figure [5]-a2 illustrates the node reduction of the block diagonal of matrix An and the r 7 ® E m term 

of A 22 - 

Figure |5]-a3 illustrates the node reduction of the block diagonal of matrix [Aj 3 Aj 3 ] T 

Figure |5]-a4 illustrates the node reduction of the term r g £g> E m of sub-matrix A 42 together with the 

block diagonals of matrices A 31 and [Aj 3 A 23 ] T 

Figures |5]-bl and [5]-b2 illustrate the node reduction for the columns formed by the matrices (not 
including the term T g ®E m from matrix A 42 already represented in Figure |5]-a4) A 12 and [A 32 Aj 2 } T 
respectively 

Figures [5]-cl to [5]-c4 illustrate the node reduction of the off-diagonal elements of matrices r 7 ® W, 



Tf <S> W, Tg <g) W, and W, from expression (51 ) respectively. 



Given the node reduction one can now proceed to construct the precedence graph of A: 
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Figure [6]-a is the graph of the block diagonal of A together with the block diagonals of the sub- 

A31 ^32 



matrices 



al to 



and [Aj 3 A^ 3 ] T using the node reductions presented in Figures 

A41 A42 

0*4. 

• Figure [6]-b is the graph of the columns formed by the matrices A 12 and [A 32 Aj 2 } T using node 
reductions presented in Figures |5]-bl and[5]-b2. 

• Figures [6]-cl and [6]-c2 illustrate two subgraphs of the remaining columns of A. Note that we only 
present the subgraphs of the first sets of and out of a total of m — 1 columns. These 
follow the same pattern. We use different attributes on the arcs, such as dashed, thick solid, etc., to 
distinguish the different node reductions, as presented in Figures [5]-c 1 to|5]-c4. 

Consider the following assumption: 

Assumption (A2). r 7 *C rf m 

Lemma 14. If assumption A2 is verified then the critical graph ofQ c (A) (and Q C (A)) has a single strongly 
connected subgraph. 

Proof: We consider two cases: 
i) r 7 = rf m = A. 

In this situation the circuits presented in Figures |5]-al and[5]-a2 all belong to the critical graph since their 
weights are t 7 or rf m both equal to the max-plus eigenvalue A. Note that any circuit C\ of length I made 
from the nodes of tg m , illustrated in Figure |5]-al, has an average weight of 



Ci 



rf* = A (74) 



Mi 1 

and as such also belongs to the critical graph. Any other circuit in the precedence graph of A must pass 
through at least one node of t£ m , as illustrated in Figures |6]-b, |6]-cl, and |6]-c2 (with the exception of the 
self-loops in Figure |5]-a3 and the circuits in Figure |5]-a4 that we don't consider since their weights are 
e and r 7 /2 both less then A). Additionally, arcs starting in nodes from a group t tq with q < m are only 
connected to nodes in t tq+p for p ^ (or h q+p ). This is again illustrated in Figures [6j-a, [6j-cl , and [6j-c2. 
Let t™^ denote element i of te q . Consider the circuit 

c 2 : t[ im ]. ->■ t [tq]j ->■ t [im]t (75) 




Fig. 5. Graph reductions. Touchdown and lift off events with indexes belonging to the same set £ q can be grouped together since they have 
the same number of output and input arcs with the same weights. 




Fig. 6. Elements of the precedence graph of the system matrix A. The total precedence graph of A is composed of all the arcs presented 
in a) and b), together with the m — 1 remaining subgraphs that follow the pattern of Figures cl) and c2). 
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with q < m. The average weight is (with r 7 = rf m ) 



A (76) 



Mi 2 2 

Circuit C2 is thus also in the critical graph. For the general circuit of the type 

cs : t [im]i ->■ -> t [<M] . 2 ->■ > t [£qi]n ->■ fy m] . (77) 



v 

! nodes 



with g x < g 2 < • ■ • < Qi < m, the average weight is 



c 3 U OrrSTf^S-Orf^ rf^f" . 

— A. (/OJ 



Icsli i + 1 i + 1 

Again, circuit C3 is part of the critical graph. Any circuit that passes through any node in lg q , for any q, 

will never be in the critical graph. This is due to the fact that arcs within touchdown nodes of different 

leg groups yield a higher weight: 

t^h ~+ %b wei § ht: r 7 ® ^ iq ~ P) (79) 
wei S ht: ® ?a (9_p) (80) 
weight: T { ®r2 (q - p) (81) 

^ wei § ht: T A q ~ P) (82) 

As such, a path that connects a touchdown node to a lift off node "loses" r 7 — r g = r f from the maximum 
possible weight, a path from lift off to lift off nodes loses r 7 , and a path from lift off nodes to touchdown 
nodes loses r g in weight. This can also be observed in the structure of A, in equation (51), where the 
sub-matrix n © (r g © W © V) overcomes the sub-matrices r g © W © V, rf © jy, and Consider, for 
example, the circuit c 4 : 



Q : % m ] 4 -> t [lp] ->■ -> % m]i (83) 



then 



|c*|„ rf p © (r g © rf) © (r f © rf _ r 7 © rf 



< A. (84) 



k-4 1 3 3 

Since all the nodes in the critical graph are connected (they are all touchdown nodes) we conclude that 
for the case r 7 = rf m = A the critical graph of A has a single strongly connected subgraph. Figure |7]-a 
illustrates the complete critical graph of A for this case. 



ii) r 7 < rf m = A. 

In this situation only circuits of the type c\ are part of the critical graph. Circuits of the type c 2 or c 3 are 
not part of the critical graph. Figure [TJ-b illustrates the resulting critical graph of A. Since all the nodes 
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of tt m are connected to each other we conclude that for the case r 7 < rf m 



A the critical graph of A 



has a single strongly connected subgraph. 



A third case can be considered: r\ 



A. In this situation the critical graph of A does not have 



a single strongly connected subgraph. Figure [7]-c illustrates this situation, that we document here without 
proof. □ 

Theorem 15. Given assumptions Al and A2, the max-plus eigenvalue A of the system matrix A (and A), 



defined by equation (54), is unique, and the max-plus eigenvector v of A (and A), defined by equations 



55|)-(f56P is unique up to a max-plus scaling factor. 



Proof: According to Lemma 12 A is irreducible, and as such it has a unique max-plus eigenvalue. 



According to Lemma 14 the critical graph of G C (A) has a single strongly connected subgraph, and as 
such its max-plus eigenvector is unique up to a max-plus scaling factor (see [[II, Theorem 3.101). □ 



E. Coupling time 

Theorem [6] on page [9] describes an important property of max-plus-linear systems when the system 
matrix A is irreducible: it guarantees the existence of an autonomous steady-state regime that is achieved 
in a number of finite steps k , called the coupling time. Computing the coupling time is very important 
for the application of legged locomotion since it provides the number of steps a robot needs to take to 
reach steady state after a gait transition or a perturbation. 

Lemma 16. Given assumptions Al, A2, the coupling time for the max-plus-linear system defined by 
equation ([75]) is k = 2 with cyclicity c — 1. 



Proof: Computing successive products of A and taking advantage of its structure and equations (43 ) 



(45) one can write its p-th power A^ p , valid for all p ^ 2, illustrated by equations (88) and (90). By 



inspection of the expression of A® p in (88 )-(90) one can observe that most terms are max-plus multiplying 
by a power of the max-plus eigenvalue A (recall that with assumption A2 we have A = rf m ). To factor 



out A of the matrix composed by expressions (88) and(90) we show that 



W 



Since A > r~ it is sufficient to show that 



r f <g) V <g> W ^ r 7 



W 



(85) 



(86) 



This can be confirmed by inspecting equations (48) and (92): 
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71 ® (a®< p ~ 2 > (girf^rg^l/OWe A®^" 1 ) (g) v e r®^- 1 ' ® t® p ® w) 
a ®(p-2) 8ff8Tg8 y 8Vffi a ®(p-i) g) y r ®Cp-i) g, r ® P g, w 

T f ® (a® (p " 2) ®Tf®T g ®V®We A 8 ^" 1 ) ® v) 



(88) 



(89) 



\ : -''t>l 



Tt ® (a® (p - 2) ® r f ® v ® w e (r f ® Tg)®^- 1 ' ® w) 
a ®(p-2) ® rf o \/ <8) w e (T f (g) Tg)®^- 1 ) ® vf 

Tf ® (a® (p - 2) ® Tf ® v ® w) 



(90) 



(91) 



Tf ® V ® W 



rf m ® li 



Tf^- 1 '®!™,! 



T« ® li m 



(92) 



.4' 



Kp+i) 



= A 



T f <g> ^A® (p - 1} ®r f ®r g ®l/®W©A® p ®V r ) T f ® ^A* 8 ^ -1 ' ® T f ® V ® w) 

A ®(p-i) ® Tf ® T g ® V ® W A® p ® V A ®(p-i) ® rf ® \/ ® w 

Tf ® (a® (p " 2) ®Tf®T g ®T/®W0 A® (P_1) ® V\ Tf ® ^A® (P " 2) ® Tf ® V" ® 

A ®(p-2) Orf^rg^l/oV^e A 0(p_1) ® V A ®(p-2) g, Tf g y g w 

A® A® p 



(93) 

(94) 
(95) 



1) All the terms in the upper block triangle of r 7 <g> W are e while for r f <g> V <g> W they are positive 
numbers. 

2) In the block diagonal [r f <g> V <g) W]^ = rf m <g> I ^ r 7 <g> £ = [r 7 <g) W]^, by assumption A2. 

3) In the lower block triangle [r f ® V <g> W] ii3 - = r ®( m+i -') g, 1 ^ j-®^') ® r 7 ® 1 = [r 7 ® by 
assumption A2. 



Taking advantage of this simplification one can obtain equations ( [89] ), ( |9T| ), and ([93])-([95]). Together with 
the similarity transformation we obtain the result valid for p ^ 2: 

A v(p+i) = c ® ® C T = C ® A®A 0P ®C T = A® A® p , (87) 

thus concluding that the coupling time is k = 2 with cyclicity c = 1. □ 

V. Conclusions 

We have shown that max-plus linear models are very well suited to model leg synchronization in 
legged locomotion. The abstraction of the continuous-time dynamics associated with each leg as a two- 
event circuit simplifies the construction of a gait space. The combinatorial nature of this gait space, arising 
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from all the possible arrangements in which multiple legs can be synchronized, is captured by a compact 
representation as an ordered set of ordered sets. 

For the classes of switching max-plus linear systems developed in this paper important structural 
properties of the max-plus system matrix are obtained in closed-form. The unique max-plus eigenvalue 
represents the total cycle time, the unique (up to a scaling factor) max-plus eigenvector dictates a unique 
steady-state behavior, and the coupling time reveals the transient response to gait switching or disturbances. 

Although some of the derivations in this paper are quite lengthy, using a combination of discrete- 
event algebraic tools with graph-theoretic concepts has lead to an important result in robotics: since the 
coupling time was found to be two, we have shown that legged robots can switch gaits (or rhythms) or 
recover from large disturbances in at least two steps. In the derivation process we have found that similarity 
transformations can facilitate the algebraic manipulations by exposing the structure of the system matrices. 
This was important to find closed-form expressions to the eigen-structure of the system and the coupling 
time, that typically need to be computed via simulations of using numerical procedures. On the graph 
side, the node-reduction procedure has allowed depicting graphs that can have an arbitrary large number 
of nodes. A graph-theoretic proof is needed for proving the uniqueness of the max-plus eigenvector. Our 
results are valid for robots with an arbitrary number of legs. 

Further research will look towards relaxing the structure of the system matrix to address the synchro- 
nization of general cyclic systems and towards the modeling of more general gaits. 
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